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Abstract 

A general study of symmetries in optimal control theory is given, starting from the presym- 
plectic description of this kind of system. Then, Noether's theorem, as well as the corresponding 
reduction procedure (based on the application of the Marsden-Weinstein theorem adapted to 
the presymplectic case) are stated both in the regular and singular cases, which are previously 
described. 
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1 Introduction 

The application of modern differential geometry to optimal control theory has meant a great ad- 
vance for this field in recent years, begining with R.W. Brocket's pioneering work [6], [7], up to 
recent developments, as reported, for instance, by H.J. Sussmann [31], [32], [33]. This paper is 
devoted to studying optimal control problems with symmetry in a geometric framework. 

Hence, our standpoint is the natural presymplectic description of optimal control problems 
arising from the Pontryagin maximum principle. If this presymplectic system has symmetries, then 
the Marsden-Weinstein reduction theorem [23], generalized to the presymplectic case, as in [11], 
allows the dynamics to be simplified, thus reducing the number of degrees of freedom and giving a 
simpler structure to the equations of motion. 

Previous works on this subject have been carried out by A.J. Van der Schaft [29] and H.J. 
Sussmann [31]. The first considers symmetries of the Lagrangian and the differential equation in 
order to arrive at a Noether theorem (although no intrinsic geometric structures are used in it). In 
the second, similar results are given, but in a more general context (relaxing the differentiability 
conditions). Recently, A. Bloch and P. Crouch offered a presentation of optimal control systems 
on coadjoint orbits related to reduction problems and integrability [5]. 

In this work, we give a general description of symmetries in optimal control, classifying them 
as the so-called natural ones (which come from diffeomorphisms in the configuration manifold of 
the original problem), and other symmetries of the associated presymplectic system. Moreover, the 
reduction procedure is described both in the regular and the singular case. (A different point of 
view on this problem, using Dirac structures and implicit Hamiltonian systems is given in [3] and 
[4]. Other approaches can be found in [9], [10] and [24]). 

More precisely, Section 2 is devoted to stating the problem and describing the presymplectic 
formulation. Since in this situation there is no global dynamics, we study the application of a 
presymplectic algorithm (see [13]) to obtain the (maximal) manifold where the dynamics exists and 
the equation of motion on this last manifold. The analysis of the procedure leads to a distinction 
between the regular situation, where only one step of the algorithm is needed, and the singular one. 
Later on, in Section 3, after reviewing some basic facts of actions of Lie groups on presymplectic 
manifolds, different notions of symmetries for autonomous control problems are defined, and the 
reduction procedure as well as Noether's theorem are stated for both the regular and singular 
cases. In Section 4, the results are then extended to the case of non- autonomous control problems. 
Finally, in Section 5, two examples are given: In the first one the reduction of regular optimal 
control problems invariant by a vector fields is considered, following the study given in [26] for 
time-dependent Lagrangian mechanics. The second corresponds to an example analyzed by H.J. 
Sussman in [31], and consists in searching for the shortest paths with a bounded curvature. 

All the manifolds are real, connected, second countable and C°° . The maps are assumed to be 
C°° and the differential forms have constant rank. Sum over crossed repeated indices is understood. 
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2 Geometric description of optimal control theory 
2.1 Optimal control problems 

Let W = U x V C R n equipped with coordinates {q\u a } (i = 1, . . . , m, a = 1, . . . , n — m). {q 1 } are 
the coordinates in the configuration space V C R"\ and {u a } are said to be the control variables 
or coordinates of the control space U C R n ~ m . An optimal control problem consists in finding C 1 - 
piecewise smooth curves j(t) = (q(t),u(t)) with fixed endpoints in configuration space, q(t±) = q\ 
and q{t2) = q2, such that they satisfy the control equation 

q\t)=F\q(t),u(t)) (2.1) 

and minimize the objective functional 

%]= f 2 L{qit),u{t))dt . 



where F ! ,L G C°°(W). Solutions to this problem are called optimal trajectories (relative to the 
points qi and q 2 ). 

It is well-known (see [20] ) that the solution to this problem is provided by Pontryagin 's maximum 
principle, which is stated in the following way: 

First, consider the co-state space T*V, whose coordinates are denoted by {q\pi\ (i = 1, • • • , m), 
and take M = UxT*V, with coordinates {q l ,Pi, u a }. Then consider a family {H(q,p, u)} C C°°(M) 
of Hamiltonian functions, parametrized by the control variables, given by 

H{q,p,u)=p l F i {q,u) -p L(q,u) . (2.2) 

where po can be regarded as another parameter. For each control function u(t), we can find the 
integral curves (q(t),p(t)) of the Hamiltonian vector field which are the solutions to the Hamilton 
equations 

cf = ^|f^, ? = -™^ (i = l,...,m). (2.3) 
Secondly, the maximal Hamiltonian function is defined as: 

H m ax(q,p) = max H(q,p,u) , for every (q,p) G T*V , (2.4) 

then we have: 

Pontryagin's maximum principle: If a curve j(t) = (q(t),u(t)) is an optimal trajectory 
between q\ and qi, then there exists a curve p(f) such that: 

1- (<?(*)) p(t)i u (t)) is the solution to (2.3), and 
2. H(q(t),p(t),u(t)) = H max (q(t),p(t)). 



If po = 0, then the optimal solutions are called abnormal. In this paper we confine our attention 
to the case in which po ^ 0, and in particular we take the typical value po = 1. 
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It is clear that a necessary condition for H to reach the maximum (if the maximum of H is not 

on the boundary of the control set) is 

9H , , , 

Xa= dv° = ( a = 1 '---' n_m )- ( 2 - 5 ) 

Hence, the trajectories solution to the optimal control problem lie in a subset Mi of the total space 

M, which is defined by the constraints Xa = 0. 

In most cases, the constraint functions Xa = 0, called first order constraints, define implicitly 
n — m functions ip a such that 

u a = r(q,p) (2.6) 

dXa 

whenever the matrix defined by W a b = ttt is non-singular, i.e., det W a b / 0. Under these circum- 

ou° 

stances, the function tp = {tp a }, given by equation (2.6), is called an optimal feedback function. If 
such a condition is satisfied, we say that the optimal control problem is regular. If det W a b = on 
Mi, we say that the optimal control problem is singular. In any case, we will assume that rank VF a ft 
is constant on the domain of our analysis. 

Remark 1 One of the consequences of the Maximum Principle is that the optimal control problems 
can be studied as presymplectic Hamiltonian systems; that is, those where the 2-form is degenerate. 
Next we give a concise description on this topic, as well as the associated constraint algorithm. 
Furthermore, in Section 3, we study the existence of first integrals for optimal control problems 
with symmetries (see Theorem 1). 



2.2 Optimal control problems as presymplectic Hamiltonian systems 

Taking into account the above considerations, a problem of optimal control, from a geometric 
viewpoint, may be given by the following data: a configuration space which is a differentiable 
manifold Q, locally described by the state variables q l (i = l,...m), a fibre bundle tt: E — > Q 
whose fibres are locally described by the control variables u a (a = 1, . . . , n — m), a vector field X 
along the projection of the bundle, X:E — > TQ (i.e., tq o X = tt, where tq:TQ — > Q denotes 
the canonical projection), and a "Lagrangian function" L: E — > R. Consider the family of paths 
ry-.I—tE such that tt o 7 has fixed end-points, which are solutions to the differential equation 

Ttto 7 = (vro 7 )- =Xo 7 (2.7) 

that rules the evolution of the state variables, i.e., in local coordinates it is equation (2.1), with 
boundary conditions q\ = q l {t\) to q\ = q l {t-i) (there are no boundary conditions on the control 
variables). The problem is to find a minimum of the action 

/ £(7(*))d/ 

J-y 

for this family of paths 7. So we have the diagram 

Ttt 

TE TQ 




/ -J— E — Q 
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Therefore, an optimal control problem is characterized by the data (E, ir, Q, L, X). 

Remark 2 It is easy to show that this is indeed a vakonomic problem on the manifold E (see 
[2], [15] for this kind of problem), where the Lagrangian L is singular, since it does not depend on 
the velocities. The constraint submanifold C C TE, given by the differential equation above, is 

C = {w G TE | Ttt(w) = (Xo t e )(w)} . 

In this way, a path 7 is admissible if, and only if, it is a solution to the differential equation (2.7) 
or, equivalently, if it takes values in the affine subbundle C of TE. Notice that, in coordinates, and 
from a variational viewpoint, the constraints defining C as a submanifold of TE (which are the set 
of first order differential equations (2.1)) are very particular: they give the velocities of the state 
variables in terms of the state and control variables. 

Optimal control theory admits several geometric formulations and expressions of the equations 
of motion (2.3) and (2.5). One of the most interesting is the presymplectic description which can 
be constructed on the manifold tt*T*Q = E XqT*Q (for a description on presymplectic dynamical 
systems, in general, see for instance [8], [13]). We denote by 7Ti: n*T*Q — > E and n 2 : n*T*Q — > T*Q 
the projections onto the first and second factors, respectively. Then, the Hamiltonian function (2.2) 
can be defined intrinsically as 

H = X — L , (2.8) 

where we identify the Lagrangian function L G C°°(E) with its pull-back through tti:it*T*Q — > E, 
and X:ir*T*Q — > R is the function defined by X((q,u),a) = a(X(q,u)), for (q, u) G E and 
a G T*E. 

Let #0 an d ujq = — d#o be the canonical 1 and 2-forms in T*Q. We can take their pull-back 
through 7T2, obtaining 6 = 7r|#o an d = vr^o i n ft*T*Q. In local coordinates, 9 = pidq 1 and 
lo = dq l A dpi. If rj is a path on tt*T*Q, then to solve the presymplectic equation 

ijj to = dH o rj 

is equivalent to solving the equations of motion (2.3) and (2.5). To show this, it is enough to write 
their local expressions. If rj is an integral curve of a vector field T on ir*T*Q, we can write the 
presymplectic equation above as 

i T u = dH. (2.9) 

Summarizing, our geometrical interpretation of the problem of optimal control stated in the begin- 
ing is given by the presymplectic Hamiltonian system (tt*T*Q,uj, H), which arises from the original 
data (E, ir, Q, L, X). 

Observe that relation (2.9) gives the critical curves of the variational problem for the Lagrangian 
L with constraints (2.7), and it is a weaker condition, in general, than the maximum principle posed 
by equations (2.3), (2.4). Througout this paper, we will restrict our attention to the analysis of 
solutions to (2.9), and the existence of true extremals will not be studied. 

From now on, we will denote M = ir*T*Q. Relation (2.5) is the local expression of the com- 
patibility condition for the equation (2.9) and it is assumed that it defines a closed submanifold 
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Mi in M. In the following section, all these features will be studied in detail, and we show that 
the regularity of the optimal control problem is equivalent to the existence of a unique vector field 
solution to (2.9) tangent to the first order constraint submanifold M\. Otherwise, the optimal 
control problem is singular, and a constraint algorithm is needed to solve the problem, in general. 

2.3 Constraint algorithm for optimal control problems 

Consider the presymplectic dynamical system given by (M,uj,H), with M = tt*T*Q, lo = tt%u>o, 
and H being defined by (2.8). The presymplectic dynamical equation is (2.9). Notice that u is 
degenerate, and kerw = 2 V( ^ 2) (M) = {X G X{M) \ tt 2 *X = 0}. It is well known [13], [25] that 
there are vector fields satisfying equation (2.9) only at the points of the subset 

Mi = {x G M | (Lz H)(x) = , for every Z G keicu} 

We assume that Mi is a closed submanifold of M, and the natural embedding is denoted by 
j\ \ Mi <^-> M. Now, there are vector fields T satisfying equation (2.9) on the points of Mi. These 
vector fields are defined in principle only at the points of M±, and they take values in TM^j 
(obviously, they can be extended to vector fields in M). However, in general, these vector fields T 
are not tangent to M l5 that is, they do not take values in TMi. If kerw PI £(Mi) = {0} (where 
X(Mi) denotes the vector fields of M which are tangent to Mi), then (M\,j*uj) is a symplectic 
manifold, and there is a unique vector field T defined at the points of Mi verifying (2.9). Moreover 
T is tangent to Mi because jfu is a symplectic form. As locally kerw = (d/du a ), then Mi is a 
submanifold transverse to ker u> if, and only if, det W a b / 0. So, a regular optimal control problem 
corresponds to the case where (Mi,j*w) is a symplectic manifold. 

However, if the system is singular, the vector fields solutions to the Hamiltonian equation (2.9) 
on the submanifold Mi are not necessarily tangent to M\. Thus, their integral curves can leave 
the submanifold where the extremal trajectories must lie. Thus, we must take the points of Mi 
where vector fields solutions to (2.9) being tangent to Mi exist. The subset M 2 C Mi made by 
those points is defined as 

M 2 = {x G Mi | T(xa)(x) = , for every T solution to (2.9) on Mi} . 

We assume that the subset M 2 is a closed submanifold of M±. We denote the functions defining 

(2) 

M 2 on Mi by Xj, . Repeating the argument, we obtain a family of subsets (assuming that all of 
them are closed submanifolds) defined recursively by 

M k = {x G M fc _i | T(x { b k ~ iy )(q) = 0, for every T solution to (2.9) on Mi} , k > 1 . 

The recursion stops, and M r = M r+ i = M r+2 = ■ ■ ■ for a certain r. In this way, we obtain a stable 
submanifold 

M f = n fc >iM fc 

where the dynamical equation has tangent solutions, and the integral curves of the corresponding 
vector fields are the critical curves of the singular optimal control problem. We denote by jf : Mf < -^> 
M the natural embedding. This is the constraint algorithm for optimal control problems, which 
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is similar in nonlinear control to the so-called zero-dynamics algorithm based on the notion of 
(locally) controlled invariant submanifold (see [16], [27]). 

Another geometric description of the condition of regularity and the submanifold M\ can be 
given. In fact, as we know that M = ir*T*Q = E Xq T*Q, we can consider the fibre bundle 
TT2- E Xq T*Q — > T*Q. Now, consider the Hamiltonian function H:E Xq T*Q — > R, and the 
vertical bundle Vfa)- The function H defines a map 

TH:Ex Q T*Q — ► V*(tt 2 ) 

(e,«) » T e (iJ| (7r(e))Q) ):V(7r 2 )^R 

which is called the fibre derivative of H (see [14], [12] for more details). In local coordinates, 
J r H(q,p, u) = (q,p, u, dH/du). Then, the submanifold M\ can be characterized as M\ = TH~ l (t)). 
The local regularity condition det ^ is equivalent to demanding that TEL has maximal rank 
everywhere, and it is also equivalent to the existence of a (local) section o: U — > E xq T*Q, for 
some neighbourhood U of each point (q,p) € T*Q. If there exists a global section a of 7T2, such that 
^ r iJ _1 (0) = a(T*Q), then the optimal control problem is said to be hyper-regular and, of course, 
det Wob ^ (i.e., it is regular). 

In the regular case, the 2-form u>i = jfu is non-degenerate and the manifold Mi is locally sym- 
plectomorphic to T*Q. In the hyper-regular situation, M\ and T*Q are globally symplectomorphic, 
and the symplectomorphism is constructed by means of the global section a. As a final remark, if 
Ti G £(Mi) is the unique vector field solution to the dynamical equation 

i Tl u>! = d/ii , (2.10) 

where hi = j^H, then the vector field T solution to (2.9) is obtained from I\ by using the optimal 
feedback condition (2.6). 

Notice that, in both the regular and singular cases, there is no vector field on M satisfying the 
presymplectic dynamical equation in M, but only on a submanifold Mi / M. 

3 Symmetries and reduction of optimal control problems: the 
autonomous case 

(See the appendix 5.2 for the notation, the terminology and the fundamental concepts and results 
about presymplectic reduction, which are used in this section). 

3.1 The regular case: symmetries and reduction 
3.1.1 Symmetries and first integrals 

One of the most important features in the study of dynamical systems with symmetry is the so- 
called reduction theory. 
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First, we establish the concept of group of symmetries for the non-compatible presymplectic 
dynamical system (M,u>,H), where M = ir*T*Q and H is given by (2.8), with compatible sym- 
plectic dynamical system {Mi,u\,h\), where uj\ = ]\uj and h\ = j\EL; i.e., we assume that the 
optimal control problem is regular. Notice that, in this case, in the notation of the above section, 
(P, $7) = (Mi,uji). Moreover, uji is symplectic and exact, because uj\ = j*u = j*(—dO) = —d(j*9). 

Definition 1 Let G be a connected Lie group and G x M — > M an action of G on M . Let 
(M,uj, H) be a regular optimal control problem. G is said to be a symmetry group of (M\,u\, h±) if 

1. <& leaves Mi invariant; that is, it induces an action <3?i: G x Mi — > M\. 

2. The induced action <3?i is a symplectic action on {M\,u\) (which is assumed to be Poissonian, 
free and proper); that is, for every g G G, ($i)*u;i = —uj\. 

3. For every g G G, ($i)*/ii = h±. 

This definition is justified since, if G is a symmetry group of (Mi, wi, hi), then <l? 9 maps solutions 
in solutions. To show this, let T be the vector field in M tangent to Mi solution to the dynamical 
system (2.9) in the points of Mi. Then there is a vector field T\ € X(Mi) such that juTi = T\mj. 
and verifying {■p 1 u\ = dh±. Therefore, 

= (*i);(ir! wi - d/n) = ip^niQiYgVi ~ (^iT g dhi = 
= «(*i)jri ^i - d(<E>i)*/ii = i($!)jri ^i - d/ii . 

This definition of symmetry group applies to every presymplectic dynamical system, simply by 
identifying Mi with the final constraint submanifold Mf, in the sense that it works for the case 
when the 2-form uj\ (or loj in the general case) is degenerate (in that case, in Condition 2, the 
action is a presymplectic action on (Mf,u>f)). 

In Definition 1, we have considered actions on M which induce symmetries on the symplectic 
manifold Mi if the optimal control problem is regular (symmetries on the presymplectic final 
constraint submanifold, in general, if the problem is singular). It is straightforward to show that 
if G is a symmetry group of (M,u,H) (i.e., §*uj = Q and &*H = H, for all g <G G), then it is a 
symmetry group of the associated compatible presymplectic dynamical system. However, the group 
of symmetries of (M, oj, H) is smaller, in general, than the group of symmetries of (Mf,Uf, hh), in 
the sense that it gives fewer symmetries of the dynamics F f . 

There is a more natural definition of transformation of symmetry for optimal control systems 
strongly related to the special characteristics of the problem. Let us recall that an optimal control 
problem may be given by the data (E, ir, Q, X, L), where Q is the configuration space describing the 
state variables, it: E — > Q is a fibre bundle whose fibres describe the control variables, X: E — > TQ 
is a vector field along it (i.e., tq o X = n), and L: E — > R is a Lagrangian function. 

Definition 2 Let *$>:E^E be a bundle diffeomorphism, and (p:Q — > Q the induced diffeomor- 
phism on the base manifold (7ro\l/ = (pow). We say that \I/ is a transformation of symmetry of the 
regular optimal control problem described by the data (E, ir, Q, X, L) if 
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1. *&*L = L is a symmetry of the Lagrangian function). 

2. = X is a symmetry of the vector field) . 

In the definition, the push-forward ^*X is defined by 

^1 = ^010$-' . (3.1) 
Hence the inverse ^* of the push-forward is = ip~ l o X o 

If the diffeomorphism ^ is understood as a change of coordinates in the state and control 
variables then, in nonlinear control, it is called as feedback transformation, and the push-forward 
^>*X is the differential equation X transformed via the feedback transformation (see [16], [17], [27]). 
Moreover, ^ being a symmetry of X means that the induced diffeomorphism <p is a symmetry of 
X in the sense of [18] and 



The meaning of this definition will become clear in Theorem 1, where we prove that, if G is a 
connected Lie group such that fy g is a transformation of symmetry of the regular optimal control 
problem, for every g G G, then ^ g maps optimal trajectories into optimal trajectories (see also 
[10]). 

Now, let Z G X(E) be a vector field on E, and let X: E — > TQ be a vector field along the 
projection ir: E — > Q. If Z is 7r-projectable, then we can define the Lie derivative of X along Z as 
follows: if * t denotes the flow of Z and ipt denotes the flow of the vector field Zq = ir^Z G X(Q), 
then 

, (3.2) 



^"5 



t=0 



or, equivalently, 



Yj/* v- V 

L Z X = lim^ . (3.3) 

t^o t 

Notice that the push-forward is well-defined since from the projectability of Z we deduce that 
is a bundle mapping. It is clear that Lz X: E — > TQ is a vector field along it. 

The following lemma gives the algebraic expression of this Lie derivative. 



Lemma 1 Let X: E — > TQ be a vector field along the projection n: E — > Q, and let Z G 3L(E) be 
a n-projectable vector field on E, with Zq = ir^Z G X(Q). Then, for every f G C°°(Q), i/te Lie 
derivative L z X(f) G C°°(£') is 

LzX(f) = Lz(Lx(f)) - Lx(Lz (/)) , 
i.e., Lz(X) = Lz °Lx ~Lx °Lz () - 



( Proof) From (3.3) we must evaluate (* t *X - X)(/)(m), for every / G C°°(Q) and m £ E. 
Using (3.1), we obtain 

(V* t X - X)(f)(m) = X Mm) (fo V _ t )-X m (f) = 

= X ^> t {m){f f-t) ~ X ^ t {m){f) + X f t ( m )(f) ~ X m(f) ■ 
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Hence 



(LzX) m (/) = lim( 




) 

/ m 1 



lim ^llf^AL ° ^"^ ~ X ^W^) 
t->o t 



= (MM/))) 



m 



(Lx(Lz (/))) 



m 



□ 



Definition 3 Let Z G X(E) be a n-projectable vector field. The vector field Z is called an infinites- 
imal symmetry of the regular optimal control problem (L, tt, Q, X, L) if 

1. XjZ L = (Z is an infinitesimal symmetry of the Lagrangian function). 

2. Lz X = (Z is an infinitesimal symmetry of the vector field X) . 

We finish these definitions of symmetries with the idea of symmetry group of an optimal control 
problem. 

Definition 4 Let G be a connected Lie group, and ty: G x E — > E an action of G on E such that, 
for each g G G, ^> g is a bundle mapping, with induced mapping (p g :Q^>Q. G is said to be a 
symmetry group of the regular optimal control problem described by (E,ir,Q, X, L) if every 
g € G, is a transformation of symmetry. 

This concept of symmetry group of regular optimal control problems is related to the idea 
of symmetry group of the presymplectic dynamical system (M, u>, H) (or, equivalently, symmetry 
group of (Mi, wi, h±), since the problem is regular) as follows: given the above action ^>:GxE — > E 
preserving the bundle structure tt: E — ► Q, we can lift this action to an action G x ir*T*Q —> 
it*T*Q in a natural way: for every (q,u,p) G it*T*Q (where u G E q and p G T*Q), 



Theorem 1 If G is a symmetry group of the regular optimal control problem (E,tt,Q,X,L) (i.e., 
^g'-E — > E is a transformation of symmetry, for every g G G), then the action $ given by (3.4) is 
a symmetry group of the presymplectic dynamical system (ir*T*Q, u, H). Moreover, the action is 
exact and there exists a comomentum map 



in such a way that the functions /e = i^9 are constants of motion. 

Conversely, if the lifted transformations $ 9 are symmetries of the presymplectic dynamical 
system, then the fundamental vector fields £ are infinitesimal symmetries of (E, tt, Q, X, L). 




(3.4) 
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( Proof ) On the one hand, the action ^ is a bundle mapping (for every g £ G, <p g is an action 
on the base manifold Q), in such a way that ip*: T*Q — > T*Q is symplectic and exact (<^#o = #o)- 
Then, since the new action <& is the canonical lift of * to an action in 7r*T*Q and 9 = tt^Oq, then 
$*# = 6* ($ is exact), so we have §*lu = u. On the other hand, Q*H = ®*X - §*L = X — L = H. 
Finally, the existence of the comomentum map follows from the exactness of the action. 

Conversely, notice that if^:Gx.E^.Eisa bundle action such that G is a symmetry group 
of the presymplectic system (ir*T*Q, u>, H), then &*(H) = H implies that £, C (H) = 0, where £ c are 
the fundamental vector fields associated with the action <F It is clear that £ c are the lifting to 
ir*T*Q of the fundamental vector fields £ associated with the action ^. The local expressions of 
such fundamental vector fields associated with actions \I> and $ are 



dq l du a 
d d£Hq) d d 



Then, 

e(H) = C(p i X'{q,v))-i c (L(q,u)) 




dqi dqi du a I \ dx l du 

Therefore, as pi are free, we obtain 

= 0^ (3.6, 

But, from Lemma 1, equation (3.5) is the expression in local coordinates of Condition 2 in 
Definition 3, L^ c X = 0, and equation (3.6) means £(L) = 0, which is is equivalent to Condition 1 
in the same definition. Therefore, the fundamental vector fields £ are infinitesimal symmetries of 
the optimal control problem (E, ir, Q, X,L). □ 

We can compare this statement with other versions of Noether's theorem in control theory For 
instance, in [19], a particular optimal control problem on a Lie group is studied: the conserved 
quantity related to the Casimir of the Lie group is used to find the shortest path of a car moving 
under the suitable conditions. In [29], the author studies the reduction of the Hamiltonian system 
associated with an optimal control problem (by the Maximum Principle), by a local symmetry given 
by a vector field. In [31], given an optimal control problem, the author uses the Maximum Principle 
to construct a family of symplectic Hamiltonian problems parametrized by the controls (instead of 
using the presymplectic alternative). Then, constants of motion are related to the action of a Lie 
algebra on M. The techniques are symplectic but local, and reduction is not studied. Finally, the 
situation studied in Theorem 3 in [34] is the following: if an optimal control problem, formulated 
on R n , is invariant by a one-parameter family of (7 1 -maps, then a conservation law is obtained. 

Remark 3 As mentioned in Section 2, an optimal control problem can be understood as a vako- 
nomic problem where the Lagrangian function L: TE — > R is a basic function and the constraint 
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submanifold C is the affine subbundle locally described by the contraints q l = X l (q, u), i = 1, . . . , n. 
Following Arnold et al [2] , a transformation of symmetry of the vakonomic system is a diffeomor- 
phism ®:TE — > T.E such that $|c(C) C C and $*(L|c) = £|c- But L\ c = L, since L is a basic 
function, so this last condition can be written as 3>*(L) = L in this case. It is easy to show that 
these two conditions are the conditions we have assumed above when $ is a diffeomorphism adapted 
to the bundle structure. 

3.1.2 Momentum map and geometric reduction 

Now, if we have the compatible dynamical system (Mi, wi, h) and the action <E>i, we are interested in 
removing the symmetries by following a reduction procedure in order to get a symplectic dynamical 
system. We apply the results of the appendix 5.2, where now P = M\ and CI = u\ is symplectic 
and exact. In what follows we assume that the action is Poissonian, free and proper. 

Let J be the momentum map associated with this action, [i E g* a weakly regular value, 
j M : J~ x {[i) <^-> M the natural imbedding, and = j*u>i and = j*hi. Therefore: 

Proposition 1 (J'~ 1 (fi),LL>^,h ll ) is a compatible presymplectic Hamiltonian system. 

( Proof ) If we denote by gMi the set of fundamental vector fields on Mi with respect to the 
action 3>i, and Ti is the Hamiltonian vector field associated with the Hamiltonian function hi, 
then, for every constraint (, with d£ = i^ Ml wi, £ Ml G gA/i) defining J r ~ 1 ( / u), 

•V r i(C) = f^ir 1 dC) = j*^(ir 1 w) = -^(i^ iri w) = -j^i^i dh i) = • 
Therefore, Fi is tangent to J~ l {p). Moreover, if T ^ G X(J'^ 1 (fi)) is a vector field such that 
jn* r n = Til^-i^), then 

«r M Up - dhf, = j*(i Tl uji - dhi) = , 

so the dynamical equation 

ir„ - d/i M = (3.7) 
is compatible and its solutions are T M + ker u^. □ 

The last step is to obtain the orbit space (J'~ 1 (/j,)/G fM ,uj) (see Theorem 2). Consider the 
presymplectic Hamiltonian system (J'~ 1 (fi), oj^, h^), and the canonical projection tt^: J~ l (ii) — > 
i7 _1 (/x)/ker uj^. As {M\,u-\) is symplectic, J~~ 1 (fj<)/G ll = J~ 1 (fi)/ker uj^. Moreover, by the 
Marsden-Weinstein theorem, a symplectic form u> G 4? 2 (j7" _1 (/x)/ ker w M ) exists such that uj^ = 7r*u>. 
Then: 

Proposition 2 T/ie function and the vector field T ^ G X( l 7 _1 (^)) satisfying (3.7) are tt^- 
projectable, and (J r_1 ( / u)/ker uj^,uj,h) is a symplectic Hamiltonian system, where 7r*/i = /i^. 

( Proof ) In fact, L^m x h^ = 0, for every £^ G g^ 1 C gM 15 since /ii is G- invariant and then h^ is 
G M -invariant. Furthermore, for every i^Jf 1 G g* fl , since uj^ and /i M are G^-invariant, we have 
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and then [^jf 1 ^^ G ker oj^. But, as all the elements of ker uo^ can be expressed as = f 1 ^, 
then we also have that [Z M ,r M ] G ker to^, for every G ker u^. Therefore, V ^ is 7r M -projectable. 

Finally, since g^ 1 = ker oj^, for every x G »7 -1 (m), then J~ 1 ([jl) /G^ = J~~ 1 (fi)/ kei u>^. As a 
consequence, ( l 7 _1 (/i)/ker cj m , u)) is a symplectic manifold. Hence, from (3.7), ( t 7 _1 (//)/ker uj^,u),h) 
is a symplectic Hamiltonian system and 

i t u-dh = (3.8) 
where 7r u *r u = T. □ 



3.2 The singular case: symmetries and reduction 

As already pointed out, the concept of group of symmetries can be extended in a natural way to the 
case of singular optimal control problems. Given the presymplectic dynamical system (M,to,H), 
if the optimal control problem is singular, then when we apply the constraint algorithm described 
in Section 3, a submanifold M\ is obtained. However, the 1-form uj\ = j\uj is now presymplectic 
and in the best of cases there will exist a family of vector fields satisfying the dynamical equation 
(2.9) in the points of M\ and tangent to M±. Otherwise, we apply the next steps in the constraint 
algorithm in order to obtain a final constraint submanifold Mf in which there exist vector fields 
T G X(M) tangent to Mf such that 

(iruj - dH)\ Mf = . 

If jf-Mf M denotes the embedding, let us consider the presymplectic dynamical system 
(Mf,u)f,hf), where luj = jju and hf = jfH. If the 2-form ujf is nondegenerate, then the study 
of symmetries and the geometric reduction of the singular problem proceeds in a similar way to 
the regular case, just by replacing, in Definition 1, (Mi,u>\,h) with the data (Mf,ujf,hf). It 
remains to consider the case when the compatible dynamical system (Mf,Uf,hf) is presymplectic. 
In this case we need to apply the generalization of the Marsden-Weinstein reduction theory to the 
case of presymplectic manifolds (see the Appendix 5.2), and replacing once again (M\,uji,h) by 
(Mf,LOf,hf) in Definition 1. This action is denoted In both cases the problem is given by a 
group G acting on M, and leaving Mf invariant. 

If Jf is the momentum map associated with the presymplectic action $ f and \i G g* is a weakly 
regular value, then the submanifold JJ x {[i) of Mf, the form uj^ = j*^yjf and the function = j^hf 
make a compatible presymplectic Hamiltonian system (J^ 1 ^),^^, h^). The proof is similar to the 
regular case. 

Let us denote by gM f the set of fundamental vector fields on Mf with respect to the action 
$/, and let Tj be a solution to the dynamical system ir f ujf — dhf = 0. For every constraint £ 
defining J^ 1 (fi), if d( = i^m } Uf, with £ M f G gM f , then j*rj(£) = 0. That is, the vector fields Tf 
are tangent to JJ l (pL). Moreover, if G X(^7j~ 1 ( / u)) is a vector field such that j^T^ = Tf\j- 1, 
then the dynamical equation ir M ^ — d/i^ = is compatible and its solutions are + ker uj^. 
Finally, the procedure to obtain the orbit space {J^ l (pL)/G^,uj) and the Hamiltonian function h 
follows the same pattern as in the previous section. 
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4 Symmetries and reduction of optimal control problems: the 
non- autonomous case 

In this section, we extend the previous results to the case of non-autonomous optimal control 
problems. After a description of a geometric formulation of the problem, we analyze the geometric 
reduction in the regular case. The extension of these results to the singular context is similar to 
that of autonomous problems. 

4.1 Geometric description 

If the optimal control problem is non-autonomous, then the control equation (2.1) becomes 



and the objective functional to minimize is 

S[j] = f 2 L(t,q(t),u(t))dt , (4.2) 
Jti 

where at least one of the "functions" X 1 (i = 1, . . . , n) or L depends explicitly on the time. A 
necessary condition for the existence of an optimum is still given by the Pontryagin's maximum 
principle (2.4-2.3), where the Hamiltonian function is (2.2) (if we include the time-dependence). 

Now we provide a geometric description of such equations when the maximum of H is not 
obtained on the boundary of the control set. A non- autonomous optimal control problem may 
be given by the following data: a configuration space, which is the trivial bundle pi:R x Q — ► R 
(elements of Q describe the state variables, and R is the time); a fibre bundle Idxir:~Rx E ^ ~R,xQ 
(which is the identity in the first factor) whose fibres describe the control variables; a "Lagrangian 
function" L:TlxE — > R; and a vector field X along the projection p2°(Idxir) (where p2- RxQ — > Q 
denotes the projection onto the second factor), i.e., X: RxJ? — > TQ is such that tqoX = p2o(Idxir). 
For sections a: I — > R x E (I = [ii, <2]) such that (Id x it) o a have fixed end-points, the problem 
is to find a section minimizing the action 



where p2'- R x TQ — ► TQ denotes the projection onto the second factor. So we have the following 
commutative diagramme: 



q*(t)=X\t,q(t),u(t)) 



(4.1) 




when a satisfies the differential equation 



p2 o (Id X 7r) o j a = X o a , 



I xTE 



p 2 o (Id x Ttt\ 



TQ 




I 



a 



I xE 



P2 O (Id X 7r) 



Q 
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The analog of the presymplectic description of autonomous systems shown in Section 2 is the 
following: we take the fiber bundle R x 7r*T*Q, which has canonical projections Id x 7Ti:R x 
tt*T*<5 -> R x E and Id x vr 2 : R x n*T*Q -> R x T*Q. Then the Hamiltonian function (2.2) can 
be defined intrinsically as 

H = X — L , (4.3) 

where we identify the Lagrangian function L € C°°(R x E) with its pull-back through Id x 7Ti and 
l:Rx 7r*T*<5 — > R is the function defined by X((t,q,u),a) = a(X(t,q,u)). 

If B and £1 are the pull-backs to Rx7r*T*Q of the canonical forms in T*Q, let Qh = @ + Hdt = 
Pidq 1 + Hdt. Then the solutions to the equations of motion (2.3) and (2.5) (which are obtained as 
necessary conditions from the maximum Pontryagin's principle if the control variables are interior 
points) are obtained from the integral curves of a vector field T € X(R x ir*T*Q) verifying 

i r n H = 0, i r dt = 1 , (4.4) 

where = — d@H, when we restrict the equations to the maximal manifold where a solution 
exists. 

Once again, this is a presymplectic system, and a constraint algorithm similar to the one 
developed in Section 3 should be applied. It is easy to prove that, if we denote by M = R x ir*T*Q, 
the maximal submanifold M\ where a solution to equations (4.4) exists is described by equation 
(2.5), i.e., Mi is defined locally by {ip a = 0}, where tp a = dH/du a . In this section we will assume 
that det ( d^ a du b ) ^ ^' * n suc ^ a wa ^ we can solve locally the control variables as functions 
of the other variables, u a = ^ a (t,q,p). Then, the algorithm finishes in the first step, and there 
exists a unique vector field T tangent to Mi satisfying (4.4) in the points of Mi (i.e., the optimal 
control problem is regular). In this case, Mi is locally diffeomorphic to R x T*Q. If j\ \ M\ — > M 
denotes the embedding, let h\ = H{t,q,p,^(t,q,p)) be the pull-back through j\ of H. Then 
Vt\h = jK^ltf) = Oi + h±dt, where Q\ = If dimQ = n , then dim Mi = In + 1 and is 

of maximal rank 2n, in such a way that the pair (Qih,dt) is a cosymplectic structure of Mi, since 
Clih A dt ^ 0. If Ti G Mi is the unique vector field solution to the dynamical equations 

in(fli + hidt) = , i ri di=l, 

then the vector field T is obtained from T\ by using the feedback condition u a = ^ a (t, q,p) and the 
boundary conditions. 

4.2 Symmetries and reduction 

Concerning the study of symmetries, time-dependent optimal control problems display some partic- 
ular characteristics which are worth consideration. Following the ideas in [11], if G is a Lie group, 
(M, is a non-autonomous optimal control system and $: G x M — > M is an action of G on M, 
G is said to be a group of standard symmetries of this system if, for every g <G G, 

1. $ leaves M invariant, i.e., it induces an action $i:G x Mi — ► Mi; 
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2. (3>i) ff preserves the forms Q\ and dt (it is a cosymplectic action), that is, 

($1)^1 = «i ; (* 1 )* g dt = dt; 

3. and («J?i) s preserves the dynamical function h\\ i.e., ($>i)*/ji = /ii. 

The diffeomorphisms $ g are called standard symmetries of the system. 

As an immediate consequence of this definition, if G is a group of standard symmetries of the 
non-autonomous system (M, £Ih) then, for every g G G, (&i) g preserves the form fii^: ($i) g Qih ~ 
Qih = j* (<J>*f2# — fi#) = 0. Moreover, G is a group of standard symmetries of the non-autonomous 
system above if, and only if, the following three conditions hold for every £ G g: 

(1) L^i = , (2) L ? -dt = , (3) L^i = 

At this point, reduction of regular non-autonomous optimal control problems with symmetry 
follows a similar pattern to the reduction made above of autonomous optimal control problems 
with symmetry. Actually, singular optimal control problems can be studied by using similar ideas. 

Remark 4 We would like to point out that the reduced Hamiltonian system does not describe, 
in general, an optimal control problem. To show this, it is enough to recall that every variational 
problem can be written as an optimal control problem by taking E = TQ in the control bundle 
R x E — > R x Q, and considering as control equations q l = u l (where (q % ,vP) denote the local 
coordinates in E = TQ). However, in [26] it is shown that, in general, the reduced Hamiltonian 
system is not a Lagrangian system. To study when the reduced Hamiltonian system describes an 
optimal control problem, an inverse problem should be solved. 



5 Examples 

5.1 Reduction of regular optimal control problems invariant by a vector field 

In order to illustrate the above results, we study the case where the optimal control problem is 
invariant by a vector field, that is, there exists a vector field Z G X(E) which is an infinitesimal 
symmetry of the regular optimal control problem (L, tt, Q, X, L) (see Definition 3). As Z is tt- 
projectable, let Zq = ir*Z £ X(Q). In local coordinates, 

Z = f(q)— +g a ( q ,u)— and Z = f(q)— . 
y ' dq 1 v ' du a v ' dq l 

We can lift Z <G X(E) to a new vector field Z c e X(M) (where M = ir*T*Q, as usual) whose local 
expression is 

Let tpt, *t and & t be the flows of vector fields Zq £ X(Q), Z G X(E) and Z c G X(M), respectively. 
Let T G X(M) be the vector field in M constructed by the extension of the vector field Ti G X(M\) 
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solution to the optimal control problem in Mi, using feedback condition (2.6). Then <I>jJT is also 
a solution to the dynamical system in the sense that its restriction to Mi, is again a vector field 
tangent to Mi verifying the dynamical equation restricted to Mi. 

Let us assume that the vector field Z is complete. Then Z c is also complete, and it induces an 
action 

$:RxM — ► M 

(t,(q,u,p)) i ^ & t (q,p,u) 

which restricts to a new action 

$i:R x Mi — > Mi . 

Since Z is an infinitesimal symmetry of the optimal control problem, then R is a symmetry group of 
the presymplectic dynamical system (Mi,ui, hi) under this action, and fz = (0, Z c ) is a constant 
of motion (fz is the comomentum map). Let J be the dual momentum map, and consider the 
level set 

J Y (p) = {(q,p) G Mi | PiP(q) = fi} , 

where (i£R. If Z is non- vanishing everywhere, then J^(p) is a submanifold of Mi. Moreover, 
in this case, T^^J is surjective and therefore every \i <G R is a regular value. In general, for 
an arbitrary 7r-projectable and complete vector field Z, n € R will be neither regular nor almost 
regular. If we assume that [i is at least almost regular, let us consider the dynamical system 
( J^ip),^^, hp) where j IJ ,:J~ 1 (n) ^ Mi denotes the embedding, oj^ = j*uji = (j* o j{)u = 
(jioj^yu and hp = j*hi = (j*ojl)H = (ji oj^fH. Since dimj- 1 ^) = 2 dim Q - 1, then the 
dynamical system is presymplectic, and the reduction procedure finishes quotienting by kercj^ (h^ 
is projectable under this distribution). 

It is interesting to realize that the momentum map J: Mi — > R can be extended to a map 
J:M — > R whose local expression coincides with the local expression of the momentum map J. 
The level sets are again 

J-V) = {(q,u,p) G M | (e,Z c )= Pi f(q) = ^} . 

Moreover, J is a momentum map, since the action is strictly presymplectic. 

Let (J _1 (^),(D^, Hfj) be the presymplectic dynamical system given by cD^ = j*u and = j*„H, 
where j fM :J~ 1 (fj,) <—> M denotes the embedding (again, we assume that fi is, at least, an almost 
regular value of the momentum map). The presymplectic dynamical system (J _1 (//),(D /J , H^) has 
solution in the points of J~~ 1 (fi). 

5.2 Shortest paths with bounded curvature 

The following example is a free version of a problem which is studied from a different point of view 
in [31] (see also the quoted references), and consists in characterizing the shortest C 1 -curves that 
are parametrized by arc length satisfying a curvature bound, and going from a given initial position 
and velocity to a final one. 
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In this model the configuration space is Q = R 3 x 5 2 , with local coordinates (x l ,y l ) (i = 1, 2, 3), 
with J2i{y 1 ) 2 = 1- The control space is, in principle, the closed unit ball B 3 in R 3 , and hence the 
bundle of controls is E = R 3 x 5 2 x B 3 , with coordinates (x % ,y l ,u l ) (i = 1,2,3). The differential 
equations are 

x=y ; y=yxu 

where x = (a; 1 , £ 2 , x 3 ), y = (y 1 ,?/ 2 ,?/ 3 ), u = (u 1 ,u 2 ,u 3 ), and y x u denotes the cross product in 
R 3 . The Lagrangian function for this problem is L = 1. 

The presymplectic Hamiltonian description of this system is made in the manifold E xqT*Q, 
where we have the coordinates {x l ,y l ,u l ;pi,qi) (pi,qi are the conjugate momenta associated with 
the position coordinates x l ,y l ). The canonical forms are then 

8 = pidx 1 + qidy 1 , uo = dx 1 A dpi + dy 1 A dqi 

The Hamiltonian function is 

# = <p,y) + (q,y xu) + i 

(where (, ) denotes the usual scalar product in R 3 , arising from the duality between TQ and T*Q). 
Observe that H is linear on the controls, and so it is known that the optimal solutions for the 
controls are in the boundary of B 3 ; that is in S 2 , unless y x u = 0, when every value of the controls 
gives an optimal solution. Hence we can take E = R 3 x S 2 x S 2 . 

This system exhibits symmetries which are: 

• Rigid translations in R 3 , whose action on E = Q x S 2 is as follows: for a given v G R 3 , if 
t v : R 3 — > R 3 is the translation x i— > x + v, we have that r„(x, y, u) = (x + v, y, u). 

• Rotations on R 3 which act on E in the following way: for a given rotation R G 50(3), we 
have that i?(x, y, u) = (i?x, Ry, Ru). 

That is, the group of symmetries is G = R 3 x 50(3). The infinitesimal generators are the following 
vector fields in E 



li 


d 

dx l 


(i = 1,2,3) 








u 


x 1 9 
dx 2 


x 2 9 1 9 
dx 1 ^ dy 2 


2 d 

~ y w 


u 1 9 
du 2 


u 2 9 
du 1 


& 


x 2 9 
dx 3 


x 3 9 2 9 
dx 2 dy 3 


-y 3 — 

dy 2 


u 2 9 
du 3 


u 3 9 
du 2 




3 9 

dx 1 


x 1 9 3 9 
dx 3 ^ dy 1 


-y l — 

dy 3 


u 3 9 
du 1 


u i d 
du 3 



whose canonical liftings to E Xq T*Q give the following fundamental vector fields 

4 dx 2 dx 1 dy 2 dy 1 du 2 du 1 

i d o d i d 2 & 
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• 2 — -x 3 — + 2 — - 3 9 I u 2 9 u 3 - I 

2 <9 3 <9 2 ^ 3 ^ 
<9p 3 ^ 9p 2 ^ <9g 3 ^ 9g 2 

cte 1 X 9x 3 ^ dy l ^ dy 3 U du l U du 3 

3 d 1 ^ 3 <9 1 ^ 
Sp 1 ^ <9p 3 ^ c^ 1 ^ <9g 3 

Thus {^1)^2^3)^4)^5)^6} i s a se * °f generators of g, but observe that dimg = 5. The action 
considered is strongly presymplectic, since it is an exact action in relation to the 1-form 6. The 
presymplectic Hamiltonian functions /t. G C°°(E Xq T*Q) (j = 1, . . . , 6) associated with ^ are 

= ft = 1,2,3) 

/ft = x x p 2 - x 2 pi + y 1 q 2 - y 2 qi 
/ft = x2 P3 - a; 3 P2 + y 2 93 - y 3 <?2 

/ft = - xl P3 + y 3 «i - y 1 qs 

So a momentum map J can be defined for this action, and for every weakly regular value fi = 
G g*, its level sets J~ l (ix) foliate E xq T*Q, and are defined as submanifolds of 
E Xq T*Q by the constraints = fij (j = 1, . . . , 6); that is, they are made by the points where 
the vectors p and x x p + y x q are constant. Observe that, locally, only 5 of these constraints 
are functionally independent and, as dim (E Xq T*Q) = 12, then the submanifolds J~ l {n) are 
7-dimensional (and presymplectic). Locally, each one of them can be described by coordinates 
(x l ,u l , z k ), (i = 1, 2, 3; k = 1, 2) ,where z k are coordinates which can be chosen from the set (y l , qi). 
Next, the final step of the reduction procedure consists in constructing the quotient manifolds 
{'J 1 (l J ')/G f j i ,Cl IM ) (with natural projections a^: J'^ 1 (fi) — ► J' -1 (fj,) / G ■ First notice that all the 
fundamental vector fields ^ are tangent to the submanifolds hence the isotropy group is 

= G, and the quotient manifolds J r_1 (//)/G /i are 2-dimensional. They are described locally by 
coordinates (w k ) (k = 1,2), such that a^w k are functions of the coordinates (u\z k ). 

As a particular case, we can analyze when fj, = 0. Then the constraints defining the submanifold 
J -1 (0) are 

Pi = (i = 1, 2, 3) ; y 1 q 2 - y 2 qi = , y 2 q 3 - y 3 q 2 = , y 3 q 1 - y 1 q 3 = 

that is, p = 0, and y x q = (i.e.; y = Aq, with A G R). Observe that, if j : J -1 ^) <^-> E Xq T*Q 
denotes the natural embedding, then 

#o := 3o H = 1 ; := io w = 
Therefore, in the quotient manifolds J~ 1 {Q)/Gq we have 

i/o = l , u> = 

where H G C°°(J- 1 (0)/G ) and lj G f2 2 {J~ 1 {0)/G ) are such that a* H = H and a^u = 
ujq. Hence, the dynamical equation in l 7 _1 (0)/Go has as solutions all the vector fields Xo G 
X(J r " 1 (0)/G ), whose local expressions are 

X = Fk (w) ——r (F k G C^iJ-HoyGo)) 
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This result agrees with the analysis made in [31]. 

Appendix: Actions of Lie groups on presymplectic manifolds and 
reduction 

(This appendix is a review of the results given in [11]). 

Given the presymplectic manifold (P, Q), a vector field Y G X(P) is said to be a Hamiltonian 
vector field if %y Cl is an exact 1-form; that is, there exists fy G C°°(P) (the Hamiltonian function) 
such that iyfl = d/y. We denote by Xh{P) the set of Hamiltonian vector fields in P. A function 
/ <G C°°(P) is a Hamiltonian function if there exists a vector field Yf G X(P) such that the 
above equation holds. We denote by C£°(P) the set of Hamiltonian functions in P. A vector 
field Y G X(P) is said to be a locally Hamiltonian vector field if iy ft is a closed 1-form. We 
denote by Xih(P) the set of locally Hamiltonian vector fields in P. Clearly, Xh(P) C Xih(P). 
Furthermore, Y G Xih(P) if and only if Ly fl = 0. For every Y G Xih(P) and Z G ker CI, we have 
that [Y,Z] G ker Q. 

Now, let P — > P be a diffeomorphism. is said to be a canonical transformation for the 
presymplectic manifold (P, f2) if <£*$7 = 0. In a similar way, if Y G X(P) is a vector field such that 
its flow $j satisfies <3?jfr2 = CI, then Y is said to be an infinitesimal canonical transformation of the 
presymplectic manifold. It is clear that <&*Cl = Cl if, and only if, Ly f2 = and, hence, Y is an 
infinitesimal canonical transformation if, and only if, it is a locally Hamiltonian vector field. 

Let G be a connected Lie group, g its Lie algebra and $:GxP->Pa presymplectic action of 
G on (P, Cl); that is, <I>*$7 = $7, for every g G G. As a consequence, the fundamental vector fields 
| G X(P), associated with £ G g by are locally Hamiltonian vector fields, £ G Xz^(P) (conversely, 
if for every £ G g we have that £ G Xih(P), then $ is a presymplectic action of G on P). Therefore, 
for every £ G g, L^^ = 0. We denote by g the set of fundamental vector fields. When g C Xh(P), 
the action <E> is said to be strongly presymplectic or Hamiltonian. Otherwise, is called weakly 
presymplectic or locally Hamiltonian. In particular, if (P, O) is an exact presymplectic manifold, 
$7 = — dB, and the action $ is exact (that is, <I>*6 = 0, for every g G G), then $ is strongly 
presymplectic and the fundamental vector fields are Hamiltonian, with associated Hamiltonian 
functions /g = i^Q. 

Given a presymplectic action of a connected Lie group G on the presymplectic manifold 
(P,Cl), the comomentum map associated with [30], is a map (if it exists) 

J* : g — C£°(P) 

where, if £ G g, and £ is its associated fundamental vector field, then /t is the function such that 
i^fl = d/t. The momentum map associated with <3? is the dual map of the comomentum map; in 
other words, it is a map J~:P^g* such that, for every £ G g and x G P, 



G7(*))(fl := .HOC*) = /*(*) 
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From the definitions, it follows that both the comomentum and momentum maps exist if, and 
only if, the presymplectic action on (P, fl) is strongly presymplectic (in particular, if <I> is exact 
then both mappings exist). In general, a comomentum map is not a Lie algebra homomorphism. 
An action <& is said to be Poissonian or strongly Hamiltonian if there exists a comomentum map 
which is a Lie algebra homomorphism. Once again, if the action $ is exact, then <I> is Poissonian 
and the comomentum map is given by J*{C) = z| O, for every £ G g. 

Let us assume that <3? is strongly presymplectic. If J is the associated momentum map, then an 
element \x G g* is a weakly regular value of if J~ l (ii) is a submanifold of P, and T x (J~ 1 (fi)) = 
ker T x ,7, for every x G J -1 ^). Moreover, if T X J is surjective for every x G J~ l {n), then 
is said to be a regular value. In this paper. Here, every action $ is assumed to be Poissonian, 
free and proper, and /i G g* is a weakly regular value of J". We denote by j^: J _1 {n) P the 
corresponding immersion. 

Next, we give a brief description of J r ~ 1 ( / u), for every almost regular value /ifg'. If is 
a basis of g with dual basis {a 1 } in g*, by writing \i = ^a 1 , a simple computation shows that 
there exist Hamiltonian functions associated with the fundamental vector fields such that 
J~ l {p) = {x G P | f^(x) = Hi}. In particular, if £ G g is such that £ G ker ft, the Hamiltonian 
functions can be taken to be equal to zero and, in this case, (fx, £} = 0. 

The connected components of the level sets of the momentum map J can be also obtained as 
the connected maximal integral submanifolds of the Pfaff system igQ = 0, for £ G g. Therefore, if 
x G then T xt 7 -1 (/x) = g x . As a consequence, since ker fl x C g x , then ker Q C X(J~~ 1 (/j,)) 

(where X( l 7 _1 (/x)) denotes the set of vector fields of X(P) which are tangent to l 7 _1 ( / u)). If the 
action is exact, then /g = — i^Q and the Pfaff system i^Q = can be expressed as d(i|0) = 0. 

Let G M be the isotropy group of /j, for the coadjoint action of G on g*. Then G M is the maximal 
subgroup of G which leaves J7" _1 (/x) invariant. So, the quotient l 7 _1 (/i)/G M is well defined and it 
is called the reduced phase space or the orbit space of J'~ 1 ([i). The Lie algebra g M of G^ is made 
of vector fields tangent to J~ l (ii), and we have that g M = g n X(J" _1 (/i)). 

At this point, we indicate two different possibilities. If gflker Q = {0}, then all the fundamental 
vector fields give constraints which are not constant functions, and dim v 7 _1 ( / u) < dim P. On the 
other hand, if g n kerfl ^ {0}, only the fundamental vector fields not belonging to kerfi give 
constraints which are not constant functions, and dim l 7 _1 (/i) < dim P. Anyway, inherits 
a presymplectic structure fl^ := whose characteristic distribution is ker = g^ x + keifl x , 
for every x G l 7 _1 ( / u). 

Finally, the generalization of the Marsden-Weinstein reduction theorem [23] to presymplectic 
actions of Lie groups on presymplectic manifolds is: 

Theorem 2 The orbit space J~ 1 (/i)/G ll is a differentiable manifold. If a: J~~ 1 (/j 1 ) — > J~ 1 (fi)/G tl 
denotes the canonical projection, then there is a closed 2-form Q G Vl 2 (J~~ 1 (fi)/G fi ) such that 
fi^ = a*Cl (that is, £1^ is a-projectable), and: 

• Cl is symplectic if, and only if, for every x G J' 1 ^), g^ x = ker Q^ x or, what is equivalent, 
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• Otherwise Q is presymplectic. In particular, for every x € J^ 1 ^), if ker Q x C T x J^ l {p) 
and g x fl ker £l x = {0} ; then rankJ] = rankO. 
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